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Abstract 

Broadbent and Goller (FSTTCS 2012) proved the undecidability of bisimulation equiva- 
| lence for processes generated by e-free second-order pushdown automata. We add a few 

remarks concerning the used proof technique, called Defender's forcing, and the related 
undecidability proof for first-order pushdown automata with e-transitions (Jancar and 
q ■ Srba, J ACM 2008). 

Language equivalence of pushdown automata (PDA) is a well-known problem in computer 
science community. There are standard textbook proofs showing the undecidability even for 
e-free PDA, i.e. for PDA that have no e-transitions; such PDA are sometimes called real-time 
PDA. The decidability question of language equivalence for deterministic PDA (DPDA) was 
a famous long-standing open problem. It was positively answered by Oyamaguchi [3] for 
e-free DPDA and later by Senizergues [4] for the whole class of DPDA. 
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£T) . Besides their role of language acceptors, PDA can be also viewed as generators of (infinite) 

labelled transition systems; in this context it is natural to study another fundamental equiva- 
lence, namely bisimulation equivalence, also called bisimilarity. This equivalence is finer than 
language equivalence, but the two equivalences in principle coincide on deterministic systems. 

Senizergues [5] showed an involved proof of the decidability of bisimilarity for (nonde- 
terministic) e-free PDA but also for PDA in which e-transitions are deterministic, popping 
and do not collide with ordinary input a-transitions. It turned out that a small relaxation, 
allowing for nondeterministic popping e-transitions, already leads to undecidability [2]. In [2], 
the authors of this note also explicitly describe a general proof technique called Defender's 
forcing. It is a simple, yet powerful, idea related to the bisimulation game played between 
Attacker and Defender; it was used, sometimes implicitly, also in context of other hardness 
results for bisimilarity on various classes of infinite state systems. 

The classical PDA, to which we have been referring so far, are the first-order PDA in the 
hierarchy of higher- order PDA that were introduced in connection with higher-order recursion 
schemes already in 1970s. The decidability question for equivalence of deterministic nth-order 
PDA, where n > 2, seems to be open so far. A step towards a solution was made by Stirling [6 
who showed the decidability for a subclass of e-free second-order DPDA. 

Recently Broadbent and Goller [Tj noted that the results in [2], or anywhere else in the 
literature, do not answer the decidability question for bisimilarity of e-free second-order PDA. 
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They used the above mentioned technique of Defender's forcing to show that this problem 
is also undecidable. This result helps to further clarify the (un) decidability border, now in 
another direction: a mild use of second-order operations (on a stack of stacks) is sufficient 
to establish undecidability without using e-transitions (that are necessary in the first-order 
undecidability proof [2]). 

The authors of pQ concentrate on giving a complete self-contained technical construction 
yielding the undecidability proof, however, they do not discuss in detail its relation to the 
constructions in [2]. Here, in Section [2j we try to concisely present the idea of the relevant 
first-order proof from [2], and then, in Section [3l we highlight the idea in [1] that makes 
it possible to replace the use of e-transitions in the undecidability proof with second-order 
operations. 

We hope that this note may help to popularize the Defender's forcing technique, and that 
it might be found useful by other researchers tackling further open problems in the area. 

1 Definitions 

A labelled transition system (LTS) is a (possibly infinite) directed multigraph with action- 
labelled edges. By a triple s — s', called a transition, or an a-transition, we denote that 
there is an edge from node s to node s' labelled with a ; we also refer to the nodes as to 
the states. A symmetric binary relation R on the set of states is a bisimulation if for any 
(s, t) 6 R and any transition s — > s' there is a transition t — > t' (with the same label a) 
such that (s' , t') E R. Two states s and t are bisimilar, written s ~ t, if there is a bisimulation 
containing (s, t). 

Bisimilarity is often presented in terms of a two-player game between Attacker (he) and 
Defender (she). In the current game position, that is a pair of states (si,s 2 ) m an LTS, 
Attacker chooses a transition sj — s'a (for j £ {1, 2}) and Defender then chooses a transition 

S3_j — > s 3-j> * ne P & i r ( s i' s 2) becomes the new current position. If one player gets stuck 
then the other player wins; an infinite play is a win of Defender. It is easy to verify that s, t 
are bisimilar iff Defender has a winning strategy when starting from the position (s,t). 

An e-free second-order pushdown system is a tuple (Q,T,Act, A) consisting of four finite 
nonempty sets: Q contains the control states, T the stack symbols, Act the actions (corre- 
sponding to classical input letters), and A the rules of the following three types: 

pX qa, pX (</,PUSH), pX (g, pop), (1) 

where p, q G Q, X 6 T, a G Act, and a 6 T* . The LTS generated by (Q,T,Act, A) has the 
set Q x (r + )* as the set of states; a state is written in the form g[5i][<y ■ ■ • [Sn] where q is 
a control state and Si is a nonempty sequence of stack symbols (for i = 1,2, ... ,n). By e 
we denote the empty sequence; hence [5i][#2] ' ' ' [8n] = £ when n = 0. The transitions in the 
generated LTS are induced by the rules from A as follows: 

• the rule pX qa implies p[Xj] [62] [63] ■ ■ ■ [S n ] <?["7p2p3] • • • [5 n ] if «7 ¥= £ , 
and p[Xj] [62] [63] . . . [5 n ] q[5 2 ] [S3] ■ ■ ■ [S n ] if 07 = e ; 

• the rule pX (g,PUSH) implies p[A7][5 2 ][(5 3 ] . . . [S n ] q[Xj][Xj][S 2 ][S 3 ] ■ ■ ■ [S n ] ; 

• the rule pX (q, pop) implies p[X~/][S 2 ][S 3 ] . . . [S n ] q[S 2 ][S 3 ] . . . [S n ] . 
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We remark that the definitions of second-order pushdown systems in the literature vary in 
details that are insignificant for us. If we restrict the rules to the type pX — > qa then we get 
e-free first-order pushdown systems. In this paper we do not introduce e-rules (of the types (pQ) 
with a = e); their restricted use in our paper is handled by a remark at the respective place. 

2 Undecidability of bisimilarity for PDA with ^-transitions 

In this section, we briefly explain a result from [2], namely the undecidability of bisimilarity 
for (normal, i.e. first-order) pushdown systems with popping e-rules (of the type pX — ^4 q). 
The text closely follows the beginning of Section 5.1 from [2], though it is a bit modified, 
concentrating on illustrating the ideas. 

The undecidability result is achieved by a reduction from the following variant of Post's 
Correspondence Problem (PCP). As usual, by a word u over an alphabet we mean a finite 
sequence of letters; \u\ denotes the length of u. 

Definition 2.1 A PCP-instance INST is a nonempty sequence (ux, vi), (it2> V2), ■ ■ • , (u n , v n ) 
of pairs of nonempty words over the alphabet {A,B} where \u{\ < \vi\ for all i € {1,2, . . . , n}. 
An infinite initial solution of INST, a solution of INST for short, is an infinite sequence of 
indices ^1,^2,^3, • • • from the set {1,2,..., n} such that h=l and the infinite words u^u^u^ ■ ■ ■ 
and Vi x Vi 2 Vi z ■ ■ ■ are equal. A finite sequence i\, %i, ■ ■ ■ , ig is a partial solution of INST ifi\=l 
and Ui x Ui 2 ■ ■ ■ Ui e is a prefix of v^v^ ■ ■ ■ V{ e . 

The problem inf-PCP asks if there is a solution for a given INST. 

The next proposition can be shown by standard arguments, related to simulations of 
nonterminating Turing machine computations; the respective reduction easily guarantees our 
technical condition \ui\ < \vi\ (see also [2]). 

Proposition 2.2 Problem inf-PCP is undecidable; more precisely, inf-PCP is IT^- complete. 

We now consider a fixed instance INST of inf-PCP, i.e. {u\,v\), (1*2, 1*2), ■ ■ ■ , (u n ,v n ) as 
above. Let us imagine the following game, played between Attacker (he) and Defender (she); 
this game is more abstract, it will be only later implemented as the bisimulation game. 

Starting with the one-element sequence i\, where i\ = 1, Attacker repeatedly asks De- 
fender to prolong the current sequence itit-\ . . . i\ by one it + \ € {1,2, ... ,n} (of her choice), 
to get i^xH- --h- (We use prolongations to the left, to ease the later implementation by 
a pushdown system.) Attacker can thus ask Defender indefinitely, in which case the play is 
a win for Defender, or he can eventually decide to switch to checking whether the current 
sequence represents a partial solution, i.e., whether ^i\Ui 2 ■ ■ ■ Ui t is a prefix of Vi 1 Vi 2 ■ ■ ■ t?j^; 
the negative case is a win for Attacker, the positive case is a win for Defender. In another 
formulation, the checking phase finds out whether (ui e ) R (ui e i ) R . . . (u^) 11 is equal to a suffix 
of (vi e ) R (vi e _ l ) R . . . (wjj^, where w R denotes the reverse of w. It is obvious that 

INST has a solution iff Defender has a winning strategy. (2) 

With an eye to the later implementation of the game by pushdown rules, we formulate 
an intermediate version of the game as follows. (In fact, this intermediate game replaces the 
arguments given in [2] to justify the rules of Fig. CD) 
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• (Generating phase) 

The game starts with a pair (go i\, q'o h) where %\ = 1 and go, go are auxiliary symbols 
that we can call "control states". Attacker repeatedly asks Defender to prolong both 
sequences in the current pair (go igig-i . . . ii,q' UU-i ■ ■ - ii) by some ig + i £ {1,2, ... , n}, 
thus creating the next current pair (go ig+iie . . . i\, q' H+iH ■ ■ ■ h). 

• (Switching phase) 
For any current pair 

(q hh-i ■■■k,% hh-i ■■■h) (3) 

Attacker can decide to switch (to the verification): the control state in the left-hand 
sequence changes to q u ; in the right-hand side sequence the control state changes to 
q v but before that Defender can erase a chosen prefix i(it-\ . . . ii-k and replace ii-k-i 
with a suffix w of (ve-k-i) R ', we thus get 

(qu HH-\ ■ ■ .i\,q v w i m i m -i . . . i\) where m < i and w is a suffix of V{ m+1 . (4) 

• ( Verification phase) 

Here the play is completely determined, verifying (step by step) that 
(ui^tiii^) 1 * . . . (u h ) R is equal to w ('Vj m ) /? (wt m _ 1 ) R . . . (v^) 11 . The control state 
q M signals that ij is interpreted as (ui j ) R , and q v signals that ij is interpreted as (vi 3 ) R . 
If a mismatch is encountered then Attacker wins, otherwise Defender wins. 

Property ([2]) obviously holds for the above (intermediate) game as well. We now show that 
this game is implemented as the bisimulation game in the LTS generated by the pushdown 
system in Fig. Q3 starting in the position (go-^i-L, q'oh-L)- We use the symbol Ii instead of i; 
the "bottom-of-the-stack" symbol _L is used for technical reasons. 

Any position (p"f,pj) in the bisimulation game is trivially winning for Defender. To avoid 
this "equality-win", when starting from the position (go-^i-L, q'oh-L), Attacker obviously must 
not use the framed rule qo pi (for any i S {1, 2, . . . , n}), nor q' Q — ^ pi which would allow 
Defender to choose the framed rule to install equality. The frames just highlight the use of 
Defender's forcing; the rules are constructed so that Attacker must ensure that neither him 
nor Defender ever uses a framed rule. 

In the first round of the game, Attacker is thus forced to use either qo — ^4 t (g for "gen- 
erating") or go qu (s for "switching"). In the first case Defender uses q' —^4 p^ for some 
(freely chosen) k € {1,2, . . . ,n}; the current position becomes (t/i_L,pfc/i_L). Attacker is now 
forced to use pk — ^> q' Q Ik or t q$Ik, since using an aj-transition for j ^ k allows Defender 
to install equality. After Defender's response, the current position is (qoIkh-L, q'olkh^-) where 
k has been chosen by Defender. We can thus see that the rules (Gl) implement the generating 
phase. As long as Attacker chooses g, the play goes through longer and longer pairs 

( qo hj-i t _ x ■ ■ ■ -Tix-L , q' . . . Ii 1 ±) . 

Since any infinite play is a win of Defender, Attacker needs to enter the switching phase 
eventually, by using go — > qu from (SI). The rules qo(I*)Ii — > q v w, q' (I*)Ii — > q v w 
constitute the only place where e-transitions enter the stage. These rules stand for the 
following family of rules given in (S1-t) in [2] (where i ranges over {1, 2, . . . , n}): 

go — > z, q' z, zli z, zl( q v w (for all suffixes w of v R ) . (5) 
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(Gl) rules: 



qo_ 
qo 



pi 



I 9 , 
% >Pi 



t q Ii 



Pi 



q' Ii 



Pi 



qolj 



where i ^ j 



(SI) rules: 
(VI) rules: 



qo(I*)Ii — ^4 g^u) q' (I*)Ii q v w for all suffixes w of wf 2 



g u Ji — ► g u taii[uf 
q u A — ► q u 



q v A 
q v B 



q v tailiyf) 



Notation. A rule p — > qa replaces the family pX — > qaX for all stack symbols 
X. By head(w) we denote the first symbol of to; tail(w) is the rest of w, and thus 
w = head (w) tail (w). By h(w) (head-action) we mean a if head(w) = A, and b 
if head(w) = B. Subscripts i,j range over {1,2,... ,n}; thus the rule qo — pi 

qo Pn, the rule pi —4 g ^, 
Is, etc. (Rules with 
(/*) in (SI) are explained in the text.) 



stands for the n rules qo p±, qo — >• P2, ■ 
i ^ j, stands for n ■ (n— 1) rules like pi — ^> go-^i £>8 



Figure 1: Rules from [2], showing undecidability in the first-order case 



We note that the last rule zl{ q v w could be made e-popping by remembering w in the 
control state but we prefer the given form for simplicity. The e-rules generate e-transitions 
in the respective fine-grained LTS. Nevertheless we refer to the e-free LTS where s — > s' iff 
s ■ ■ ■ s" — s'" —^4 • • • — s' in the fine-grained LTS. 

It is thus clear that Attacker is indeed forced to start the switching phase by choosing 
the rule qo q u and performing the transition qoh t h t _ 1 ■ — ■> quh l h l ^ 1 ...I^-i- 
Defender then chooses m and w, and the corresponding transition q' Ii e Ii e _ 1 . . . J^T — 
q v wli m li m _ 1 ■ . ■ iji-L (where w is a suffix of (vi m+1 ) R ). The next current pair thus becomes 

( q u I^h-i ■ ■ • Jix-L > Qv w Ii m h m ^ . . . lii J- ). 

Rules ([5]) also allow us to choose q' Ii e Ii e _ 1 . . . — zli m+1 li rn _ 1 . . . I^-L; but once we 
understand the verification phase, we can easily check that this is of no help for Defender. 
The verification phase is implemented by the rules (VI). Defender can no longer threaten 
with installing equality but this is not needed anymore; this phase is completely determined, 
giving no real choice to any of the players. It is obvious that Defender wins iff 

• • • K) R = u> (viJ R (v lm ^) R ■ ■ ■ M R ■ 

Since the described bisimulation game closely mimicks our previous (intermediate) game, it 
is easy to check that it also has Property ([2]). 
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3 Second- Order Pushdown Systems 



The "first-order" proof in Section [2] (captured by the rules in Fig. [T]) trivially shows the unde- 
cidability of bisimilarity for second-order pushdown systems when e-transitions are allowed. 
When we explore the decidability question for e-free second-order pushdown systems then it 
is natural to ask whether we can implement the switching phase (captured by (SI)) without 
using e-rules, when we have second-order PUSH and POP at our disposal. So in terms of our in- 
termediate game, we want to implement the switching from (|3]) to ((3]). Without e-transitions 
we cannot implement erasing a prefix of ■ ■ ■ i\ (in the right-hand side string) in one 

move. A natural idea is to shorten the right-hand side string step-by-step while Defender 
should decide when to finish. But it is not clear how to implement this in the "first-order" bi- 
simulation game since Defender loses the possibility of threatening with equality during such a 
step-by-step process. (Senizergues's decidability result [5j shows that such an implementation 
is indeed impossible in the first-order case.) 

The idea (i.e., the crucial point in the undecidability proof in [1]) can be explained as 
follows. When Attacker wants to switch at the position (go HH-\ ■ ■ ■ k, q'o iiU-i ■ ■ ■ k) then 
the stacks are doubled (using push), and the next position becomes 

(r [iiie-i . . . ii][iiii-i . ..ii], r' [hh-\ ■ ■ ■ i\][uig-i ■ ■ ■ k]) ■ (6) 
Now the top stacks are being synchronously shortened, the play going through positions 

h][iek-i ■ ■ ■ k\) 

for decreasing m. During this process Defender can threaten with equality, so it is possible 
to implement that it is Defender who decides when the process should stop, forcing pop on 
the left-hand side (with entering q u ) and choosing a suffix w of {vi m+1 ) R on the right-hand 
side; the reached position is then 

(q u [ieie-i ■ ■ -k], q v [w i m i m -i ■ ■ ■ h][kie-i ■ ■ ■ k}) ■ (7) 

The bottom stack on the right-hand side is now superfluous; it only served for the previous 
threatening with equality. The verification phase is the same as previously (with no choice 
for any player). Implementing the described switching via the second-order rules is now a 
routine, once we understand the Defender's forcing technique. We just replace the rules (SI) 
in Fig. Q] with (Sl-2 nd ) in Fig. [2] (where i ranges over {1, 2, . . . , n}). 

Now if Attacker chooses to switch (by action s) then a position corresponding to (J6|) is reached 
(where ij is replaced with Jj., and _L is added). By Defender's forcing, Attacker must now 
use the rule r — q and Defender decides whether to enter the control state q' (meaning 
that she wishes to erase a further symbol Ii from the top stacks, by the rules qli r and 
q'li — > r') or the control state q" (meaning that she wishes to enter the verification phase, 
by the rules q — ^ p and q" p'). In the next round Attacker must follow these choices 

otherwise he will lose (by the framed rules) . The rule g_L — q forces Defender to choose the 
second option (entering q") before the top stacks are emptied (otherwise she loses). Finally, 
once a position 

(p [ii m+ Ji m ■ ■ ■ 4-L][^^_i ■ • -liiM: p' [4n+i4n • • • ^i-LPA-i • • • hiM) 

is reached, the last application of Defender's forcing results in an analogue of ([7]): 
{qu [lijie-r ■ ■ ■ IhM, qv [w h m U m _ x ■ ■ ■ I^A-WhJi^ . . . I h ±]) . 
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(Sl-2 nd ) rules: qo ^ (r, PUSH) q' (r' , PUSH) 



r — > q 



q± — > q 

P (?«,POP) 



pi, — > q v w 



qli — > r 


q'h 


— > r 




q". 




r 


q — >p 


q"- 


-^p 






q' 


C2 , 

— >p 





p'li — > q v w (for each suffix w of (u, 



Figure 2: A replacement of (SI) to show undecidability for e-free second-order PDA 



3.1 Normedness 

Bisimilarity problems like those we discuss here are often simpler when restricted to normed 
systems; in our case, a state s in the LTS generated by a pushdown system is normed if 
from each state that is reachable from s we can reach a state where the stack is empty. But 
restricting to the normed case does not affect the undecidability here. The states qoIi-L, 
q' III- in the system defined by Fig. [T]are normed, if we view the states q u -L, Q^-L as having 
the empty stack; otherwise we can add the rules q u A. —>■ q u , q v A. q v . (In [2], there are 
used the rules q u A. e, q v A. e in the context of prefix-rewrite system definition.) 

The authors of [fj are also interested in normedness for higher-order PDA as a natu- 
ral extension of normedness for first-order PDA. We can note that after replacing (SI) in 
Fig. [1] with (Sl-2 nd ) in Fig. [21 the system is not normed anymore (exemplified by the state 
q v [_L][Jj £ /^_ 1 ...Ji 1 _L]). In [lj a triple copy of the stack is used to handle the specific normed- 
ness definition there. Another possibility is to start from (go [/i-L][_L],gQ [ii_L][_L]) and add a 

new control state q P0P and the rules q u — > q P0P and x — > (q P0P , POP) for all control states x 

where x ^ q u , including the rule q P0P — > (gp p,POP). 



Additional comments 

As already mentioned, the undecidability result for e-free second-order pushdown systems 
in pQ clarifies the (un) decidability border in another direction than the undecidability result 
for first-order pushdown systems with e-transitions in [2]. The border can be surely explored 
further. For example it seems that we cannot avoid using several control states in the above 
undecidability proofs (though we can surely decrease their number by extending the stack 
alphabet). Hence (normed) second-order simple grammars, studied in [6], are a possible target 
for exploring. 
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